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1. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

2. Claim 9 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

With applicant's 8 September 2005 amendment to independent claim 8, so that it 
is now "A set-top box including a machine-readable medium...", claim 9's "The 
machine-readable medium of claim 8" is unclear, since claim 8 is no longer directed 
towards a "machine-readable medium". To expedite prosecution, the Examiner 
presumes that applicant had intended claim 9 to be a "set-top box", and not that it was 
applicant's intent to incorporate merely the "machine-readable medium" portion of claim 
8, which runs contrary to 35 USC 112, fourth paragraph by failing to incorporate the 
parent claim in its entirety. 

3. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

4. Claims 1 - 5, 13 - 17 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Gupta et'al. ("Gupta"; US #6,546,405 B2) in view of Boreczky et al. ("Boreczky"; 
US #6,366,296 B1). 

As per independent claim 1's "method" in which an "annotation file" is created for 
"a multimedia presentation", Gupta's ANNOTATING TEMPORALLY-DIMENSIONED 
MULTIMEDIA CONTENT is achieved when A human viewing temporally-dimensioned 



Serial Number: 09/997,713 
Art Unit: 2173 



Page 3 



content will annotate, comment upon, and augment the multimedia document 

(Abstract). Thus, "identifying at least one desired portion" occurs (see also col 2, lines 
13 - 35). The resulting annotation entry 300 records "at least one pointer 
corresponding to the at least one desired portion" (col 10, line 65 - col 1 1 , line 35), in an 
annotation collection 420 (the claimed "annotation file"; see also figs 3, 4). 

As per "automatically presenting only one or more portions of the multimedia 
presentation identified as being desired", Gupta's multimedia document player (col 2, 
lines 36 - 48) is one in which a user can select a temporal annotation from a list , at 
which point the multimedia document player immediately proceeds to the presentation 
of the multimedia document at the particular relative time (col 2. lines 48 - 64). In this 
immediate procession, Gupta is "automatically" performing the function of going to the 
particular relative time , showing only what is annotated at that time, and "eliminating any 
other portions of the multimedia presentation". 

Applicant has amended claim 1 , such that "automatically identifying at least one 
desired portion of a multimedia presentation" is accomplished "by user's equipment". 
The Examiner will concede that Gupta's ANNOTATING is identically disclosed as 
requiring A human 's input to determine the "desired portion", and that Gupta does not 
explicitly teach that such an action is "automatically" performed "by user's equipment". 

However, it was known in the art to use automatic detection of desirable portions 
of a "multimedia presentation", as is seen in Boreczky's MEDIA BROWSER USING 
MULTIMODAL ANALYSIS . There, Features in a media file. .. are preferably 
automatically time-wise evaluated in the media file (Abstract). In the user computing 
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environment Boreczky shows in fig 13, a mapping module 115 can automatically 
generate metadata values for all of the selectable features (col 1 1 , lines 52 - 63), so 
that "automatically identifying at least one desired portion" takes place, and is 
accomplished "by user's equipment". 

It would have been obvious to a person having ordinary skill in the art at the time 
of applicant's invention that the annotation collection developed by Gupta for multimedia 
be obtained by automatically considering the media as per Boreczky, so as to alleviate 
the need for Gupta's human input and make a more substantial set of Features 
available for user access. Motivation lies at least in Gupta, where the goal is to build as 
comprehensive a set of annotations as is possible, and this would be directly facilitated 
with the Boreczky teachings of machine-generated metadata . 

As per claim 2's "creating" and "playing the recorded program file" (see also 
claim 9), this is a function related to Gupta's multimedia document player . The content 
in Gupta must be originally created and retained in some form. Then, when the 
multimedia document player immediately proceeds to the presentation at the particular 
relative time , "only the at least one desired portion.. .is displayed. ..automatically". 

The application of "a predetermined set of criteria" in "identifying at least one 
desired portion" (claims 3, 14) reads upon Gupta's identical teaching that The user can 
select temporal annotations which satisfy various criteria for inclusion in the display of 
the multimedia document (col 2, lines 48 - 54), these being "based upon a preference 
of an individual viewer" (claims 4, 15), such as a particular date . Boreczky echoes this 
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capability of implementing user desire, when the user preferably selects at least one 
feature of the media file using the media feature selection 4 (col 1 1 , lines 34-51). 

Claim 5's "annotation file" that "further contains: information related to the at 
least one desired portion" (see also claims 12, 16, 20) generally reads upon the 
capability of an annotation such as Gupta's to hold additional information, relative to the 
multimedia document , as in the inclusion of user authored content in content field 310 of 
a Gupta temporal annotation entry 300 (col 4, lines 52 - 63). 

Independent claim 13's use of "a recorded program file" reads upon Gupta's 
storage of the original Multimedia document 140 . which can alternatively be a motion 
video or audio file (col 4, lines 28 - 51). In handling the collection 420 , Gupta uses "an 
annotation management software" so that "a display device displays only one or more 
desired portions", as noted above with respect to Gupta's multimedia document player . 

Though the amendment to claim 13 is such that the "annotation file" is 
"automatically created by said apparatus without user intervention", which is not directly 
taught in Gupta's human -based scheme, Boreczky provides such a teaching, when the 
features are determined automatically by mapping module 115 . 

The overall collection 420 in Gupta's annotation database will have "information 
related to a portion... other than the at least one desired portion" (claim 17), since 
annotations to portions other than those satisfying criteria are included. 
5. Claims 6 - 9, 12, 18, 20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Gupta in view of Kelly et al. ("Kelly"; US #5,907,322 A) and Boreczky. 
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As per independent claim 6's "broadcasting an event to a first location" and 
"simultaneously identifying at least one desired portion of the event at a location remote 
from said first location", Gupta does not contain explicit teachings of such a mode of 
transmission, being more concerned with what happens at the site of the multimedia 
document player itself. However, Kelly's TELEVISION EVENT MARKING SYSTEM 
allows for bookmarking viewer selected TV broadcast events (Abstract), and storing a 
set of event-identifier data associated with the set of selected broadcast events (see 
also col 1 , lines 54 - 67). Kelly further teaches that an activity table of viewer selection 
information is transmitted to an on-line database (col 1, lines 54 - 67), this being at a 
"location remote from" the viewer site. 

Thus, it would also have been obvious to a person having ordinary skill in the art 
at the time of applicant's invention to use the "annotation file" of Gupta, but where such 
an annotation database is made available to a broadcast receiver as per Kelly, with a 
motivation being Gupta's own disclosure of A public temporal annotation (Gupta, col 3, 
lines 4-16). Gupta teaches that annotations from plural sources can be maintained 
external to the user device, something that is facilitated by Kelly's use of a head-end 
side database . 

It would then have been further obvious to the person having ordinary skill to 
employ Boreczky, who permits such an "annotation file" to be "simultaneously" 
performed, relative to the "broadcasting": a mapping module in Boreczky can 
automatically generate metadata values and map the metadata values to corresponding 
confidence score values "on the flv" (col 1 1 , lines 57 - 60), so as to have a maximum 



Serial Number: 09/997,713 Page 7 

Art Unit: 2173 

of annotation information available to the end user or viewer. There is, as has been 
noted above, a motivation within Gupta to maximize the number of annotations 
available. The overall combination using Kelly would involve "transmitting to a viewing 
system the annotation file as a transmission that is distinct from the broadcast of the 
event", and upon receipt of the annotation, a multimedia document player arrangement 
as per Gupta will "automatically display desired portions of the event". 

The Kelly bookmarking follows the selected broadcast event , and thus, any 
"annotation file" created as per Gupta and Boreczky will be "transmitted subsequent to 
the event" (claim 7). 

Independent claim 8 is similar to claim 2 as treated above, and is suggested by 
Gupta, who teaches "creating an annotation file" in collection 420 . and "applying the 
annotation file" to render "one or more desired portions" "automatically" by the 
multimedia document player according to various criteria for inclusion . In combination 
with Kelly, this can occur at a "set-top box" location, at which mapping module functions 
such as Boreczky can be applied for "automatically creating an annotation file". 

Independent claim 18's use of "an editor to automatically create an annotation 
file" reads upon the Gupta author's creation of entries in the collection 420 . this 
invariably involving automatic processes within the annotation database system. When 
combined with the Boreczky mapping , such a collection will be developed "without user 
prompt or intervention". The use of "a first" and "second transmission medium" for the 
"presentation" and the "annotation file" is suggested by an extension to Kelly's 
broadcast environment, when receiving the additional Gupta annotations. Kelly 
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suggests that annotating information be sourced at a separate location from "a 
multimedia viewing system", as in the database origination of user-specific information. 

6. Applicant's arguments with respect to claims 1 - 9, 12 - 18, 20, filed with the 8 
September 2005 amendment, have been considered but are moot in view of the new 
ground(s) of rejection. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Raymond J. Bayerl whose telephone number is (571) 
272-4045. The examiner can normally be reached on M - Th from 9:00 AM to 4:00 PM 
ET. 

8. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca, can be reached on (571) 272-4048. All patent application 
related correspondence transmitted by FAX must be directed to the central FAX 
number (571)273-8300. 

9. Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (571) 272- 
2100. 
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